Mobile Devices, Methods, and Computer Program Products for Enhancing Social Interactions With Relevant Social Networking Information

ABSTRACT

Devices, methods, and computer program products are for facilitating enhanced social interactions using a mobile device. A method for facilitating an enhanced social interaction using a mobile device includes receiving an audio input at the mobile device, determining a salient portion of the audio input, receiving relevant information associated with the salient portion, and presenting the relevant information via the mobile device.

CROSS REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. application Ser. No.12/946,208, filed Nov. 15, 2010, the entirety of which is hereinincorporated by reference.

TECHNICAL FIELD

The embodiments presented herein relate generally to social networkingand, more particularly, to mobile devices, methods, and computer programproducts for enhancing social interactions with relevant socialnetworking information.

BACKGROUND

Computer-based social networking has garnered considerable interest fromindividuals, organizations, and businesses desiring the ability tonetwork, share data, and generally keep-in-touch with others. Manymobile devices such as smart phones have the ability to access mobileversions and, in some instances, full versions of social networkingwebsites. Some of these devices support native applications that permitnearly full-featured access to social networking platforms.

Some in-person social encounters, such as meetings, parties, chanceencounters, and other events in which individuals come together for onereason or another, can lead to opportunities of uncomfortable moments inwhich an individual engaged in a conversation or intending to engage ina conversation could benefit from information about the person with whomthey are conversing or intending to converse to facilitate furtherconversation or initiate new conversation.

SUMMARY

According to one aspect disclosed herein, a method for facilitating anenhanced social interaction using a mobile device includes receiving anaudio input at the mobile device, determining a salient portion of theaudio input, receiving relevant information associated with the salientportion, and presenting the relevant information via the mobile deviceto a user of the mobile device.

In one embodiment, the method further comprises receiving an identifierat the mobile device. The identifier identifies an individual associatedwith the audio input. In one embodiment, receiving the audio input atthe mobile device includes receiving, via a microphone of the mobiledevice, the audio input from the individual, the individual beinglocated within a range of the microphone. In another embodiment,receiving the audio input at the mobile device includes receiving, via amicrophone of the mobile device, the audio input from the individual,the individual being engaged in a vocal conversation with a user of themobile device. In another embodiment, receiving the audio input at themobile device includes receiving, via a transceiver of the mobiledevice, an audio file including the audio input, the audio input beingassociated with the individual, the individual being engaged in a vocalconversation with a user of the mobile device. In another embodiment,receiving the audio input at the mobile device includes receiving, via atransceiver of the mobile device, an audio file comprising the audioinput, the audio input being associated with the individual, theindividual being someone with whom a user of the mobile device expectsto be engaged in a vocal conversation. In another embodiment, receivingthe audio input at the mobile device includes receiving, via atransceiver of the mobile device, an audio file comprising the audioinput, the audio input being associated with the individual, theindividual being located within a pre-defined distance of the mobiledevice.

In one embodiment, determining the salient portion of the audio inputincludes converting at least a portion of the audio input into text andidentifying at least one keyword from the text, the at least one keywordbeing the salient portion. In another embodiment, analyzing at least aportion of the audio input and identifying at least one keyword from theaudio input, the at least one keyword being the salient portion.

In one embodiment, the method also includes comparing the salientportion of the audio input to social networking information to determinethe relevant information. In one embodiment, comparing the salientportion of the audio input to the social networking information includescomparing the salient portion of the audio input to social networkinginformation associated with the individual, and the social networkinginformation is retrieved from a data store associated with a socialnetwork. The social networking information may include, for example, atleast one of a name, a physical address, a telephone number, an emailaddress, a chat client handle, a user name, an avatar, a profile, aprofile picture, a post by the individual, a topic of interest to theindividual, and a specific detail about a topic of interest to theindividual.

In one embodiment, presenting the relevant information includespresenting the relevant information via at least one of a display and anaudio output of the mobile device, the audio output includes at leastone of a speaker, an audio output jack to which a wired audio outputdevice is connected, and a wireless audio output component to which awireless audio output device is connected.

According to another aspect, a non-transitory computer-readable mediumincludes computer-executable instructions that, when executed by aprocessor, cause the processor to perform steps of the aforementionedmethod.

According to another aspect, a mobile device for facilitating anenhanced social interaction includes at least one of a display and anaudio output, a processor, and a memory operatively coupled to theprocessor. The memory includes instructions that, when executed by theprocessor, cause the processor to perform steps of the aforementionedmethod.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 schematically illustrates an exemplary environment in whichvarious embodiments disclosed herein may be implemented.

FIG. 2 schematically illustrates a mobile device and components thereof,according to one embodiment disclosed herein.

FIG. 3 illustrates a method for facilitating an enhanced socialinteraction via a mobile device, according to one embodiment disclosedherein.

FIG. 4 illustrates a method for determining a salient portion of anaudio input, according to one embodiment disclosed herein.

FIG. 5 illustrates a method for determining a salient portion of anaudio input, according to another embodiment disclosed herein.

FIG. 6 illustrates a method for determining relevant information for asocial interaction, according to one embodiment disclosed herein.

DETAILED DESCRIPTION

As required, detailed embodiments are disclosed herein. It must beunderstood that the disclosed embodiments are merely exemplary examplesthat may be embodied in various and alternative forms, and combinationsthereof. As used herein, the word “exemplary” is used expansively torefer to embodiments that serve as an illustration, specimen, model orpattern. The figures are not necessarily to scale and some features maybe exaggerated or minimized to show details of particular components. Inother instances, well-known components, systems, materials, or methodshave not been described in detail in order to avoid obscuring theembodiments disclosed herein. Therefore, specific structural andfunctional details disclosed herein are not to be interpreted aslimiting, but merely as a basis for the claims and as a representativebasis for teaching one skilled in the art to variously employ thedisclosed embodiments.

Referring now to the drawings wherein like numerals represent likeelements throughout the several figures, FIG. 1 schematicallyillustrates an exemplary environment 100 in which various embodimentsdisclosed herein may be implemented. The environment 100 includespremises 102 in which a first user 104 is located. The premises 102 maybe inside or outside of a building or other structure, in a park orother outdoor setting, or any other location. The first user 104 isassociated with a first mobile device (MD) 106 that includes amicrophone 108. The first MD 106 may be a cellular telephone, a computer(e.g., a tablet computer or a notebook computer), a media playbackdevice (e.g., a portable music player, a portable recorder, or aportable video player), a handheld video game console, combinationsthereof, or the like. The first MD 106, in some embodiments, isconfigured to access a wireless communications network 110 via a radioaccess network (RAN) 111. The wireless communications network 110 mayoperate using telecommunications standards such as Global System forMobile communications (GSM) and a Universal Mobile TelecommunicationsSystem (UMTS). The wireless communications network 110 may alternativelyor additionally use any existing, developing, or yet to be developedtelecommunications technologies. Some examples of other suitabletelecommunications technologies include, but are not limited to,networks utilizing Time Division Multiple Access (TDMA), FrequencyDivision Multiple Access (FDMA), Wideband Code Division Multiple Access(WCDMA), CDMA2000, Orthogonal Frequency Division Multiplexing (OFDM),Long Term Evolution (LTE), and various other 2G, 2.5G, 3G, 4G, andgreater generation technologies. Examples of suitable data bearersinclude, but are not limited to, General Packet Radio Service (GPRS),Enhanced Data rates for Global Evolution (EDGE), the High-Speed PacketAccess (HSPA) protocol family such as High-Speed Downlink Packet Access(HSDPA), Enhanced Uplink (EUL) or otherwise termed High-Speed UplinkPacket Access (HSUPA), Evolved HSPA (HSPA+), WiMAX™, and various othercurrent and future data bearers.

The first MD 106, in another embodiment, is additionally oralternatively configured to access a local wireless communicationsnetwork 112 serving the premises 102 via one or more access points 114,such as an IEEE 802.11-compliant Wi-Fi™ access point or a femtocellnode-B. The wireless communications network 110 and the local wirelesscommunications network 112 are each in communication with a data network116, such as the Internet or an intranet. One or more data stores 118are accessible via the data network 116. The data store(s) 118 may beembodied as a database accessible by one or more servers (not shown)associated with, for example, a social networking platform to which asecond user 120 is associated. For example, the second user 120 may be amember, a registered user, a trial user, or a user in some capacity ofthe social networking platform.

The data store(s) 118 is configured to store information associated withthe second user 120 who is a user of a social networking platformassociated with the data store(s) 118. As used herein, the term “socialnetwork” refers broadly to a social structure of individuals,businesses, organizations, and/or other entities connected by one ormore types of interdependency, such as friendship, kinship, commoninterest, financial exchange, dislike, romantic relationship, religiousbeliefs, knowledge, education, prestige, or other relationship.Moreover, the social network may include one or more social networkplatforms by which members of the social network can interact. Exemplarysocial network platforms include, for example, Facebook™, Twitter™,LinkedIn™, MySpace™, Foursquare™ and the like. The social networkplatforms may be interconnected so as to share information upon useropt-in. The second user 120 may set privacy settings to regulate who isprivy to information stored in the data store(s) 118 in association withthe second user 120.

The social network, in one embodiment, facilitates social introduction,social networking, professional networking, and/or dating services. Forexample, the social network may provide social services and informationfor purposes of personal development, such as self-improvement,self-fulfillment, charitable, philanthropic, volunteer, public services,community services, and humanitarian activities. By further example, thesocial network may provide professional services and information forpurposes of professional development, such as education, training, andpractice development.

In one embodiment, the social network is a computer service such as anon-line virtual community for members to organize groups and events,participate in discussions, and/or engage in social, business, andcommunity networking. In another embodiment, the social network is acomputer service for hosting electronic facilities for others toorganize and conducts meetings, events, and interactive discussions viacommunication networks such as the wireless communications network 110,the local wireless communications network 112, and/or the data network116.

In another embodiment, the social network is provided by an applicationservice provider (ASP) that hosts computer software applications of itsown or others. In one embodiment, the ASP provides software that isaccessible via, for example, a web application or website, a mobiledevice application, a computer application, or other device applicationthat is configured to enable or facilitate the uploading, downloading,streaming, posting, displaying, blogging, linking, sharing or otherwiseproviding of electronic media or information over communication networkssuch as the wireless communications network 110, the local wirelesscommunications network 112, and/or the data network 116.

In yet another embodiment, the social network provides an online networkservice that enables users to transfer personal identity data to andshare personal identity data with and among multiple websites.

In still another embodiment, the social network enables users to createpersonal profiles featuring social networking information and totransfer and share such information among multiple websites.

In another embodiment, the social network creates indexes ofinformation, sites, and/or other resources available on computernetworks, provides temporary use of non-downloadable softwareapplications for social networking, creates a virtual community, and/orfacilitates the transmission of audio, video, photographic images, text,graphics, and/or data.

In another embodiment, the social network provides computer services inthe nature of customized web pages featuring user-defined or specifiedinformation such as personal profiles, audio, video, photographicimages, text, graphics, and/or data.

In another embodiment, the social network facilitates peer-to-browserphoto sharing services, such as providing a website featuring technologyenabling users to upload, view, and download digital photos.

In another embodiment, the social network provides computer services forproviding a web site featuring technology that enables users to uploadand share video, photos, text, graphics, and/or data.

In another embodiment, the social network provides computer services forcreating and maintaining blogs.

In another embodiment, the social network provides a web hostingplatform for use of non-downloadable software in connection withinteractive, multiplayer, and/or single player games.

In another embodiment, the social network provides a platform for socialmultiplayer gaming in which users can interact via text, voice, and/orvirtual interaction between virtual characters, machines, or objectsbefore, during, or after a game experience.

Referring again to the illustrated premises 102, the second user 120 isillustrated as being engaged in a conversation 122. The conversation 122may be between the first user 104 and the second user 120; the firstuser 104, the second user 120, and one or more other users (not shown);the second user 120 and one or more other users (not shown); the seconduser 120 and himself/herself; or the second user 120 and one or moreother users via a second MD 124, which may be embodied like the first MD106, as described above.

In any case, in one embodiment, the microphone 108 of the first MD 106is configured to receive, as input, audio 126 generated from theconversation 122. In one embodiment, the first user 104 via themicrophone 108 of the first MD 106 is able to ascertain a position ofthe second user 120 using audio localization techniques known to thoseskilled in the art. As such, the microphone 108 may be configured as adirectional or non-directional microphone with sensitivitycharacteristics designed, at least in part, for such techniques.

Information regarding the second user 120 that is potentially relevantto the first user 104 is presented to the first user 104 based upon ananalysis of an audio input (e.g., the audio input 126 or the audio file128) and social networking information associated with the second user120, as described in greater detail herein. If the audio input 126includes voice audio of the second user 120, the first MD 104 mayidentify the second user 120 using voice recognition analysis of thevoice audio, for example, by comparing the voice audio to a voice printof the second user 120 retrieved at some point from one of the seconduser 120, the second MD 124, or the data store(s) 108. Other methods fordetermining the identity of the second user 120 include short-rangecommunications between the first MD 106 and the second MD 124 toexchange identity information, as is described in greater detail belowwith reference to FIG. 3.

In another embodiment, an audio file 128 is received via a transceiver(illustrated in FIG. 2) of the first MD 106. The audio file 128, in theillustrated embodiment, is received directly from the second MD 124 viaa short-range peer-to-peer connection established via short-rangecommunications such as Bluetooth™, near-field communications (NFC),infrared, infrared data association (IrDA), other unlicensed short-rangeradio frequencies, and the like. In another embodiment, the audio file128 is received via the local wireless communications network 112. Forexample, the audio file 128 may be shared by the second user 120 withthe first user 104 such as by an ad-hoc Wi-Fi™ network between the firstMD 106 and the second MD 124, a server (not shown) of the local wirelesscommunications network 112, one of the data stores 118 of the datanetwork 116 accessed via the local wireless communications network 112,or one of the data stores 118 of the data network 116 accessed via thewireless communications network 110. In any case, the audio file 128 mayinclude at least a portion of a present conversation (e.g., theillustrated conversation 122) or a previous interaction between thefirst user 104 and the second user 120.

The audio file 128 may be formatted in an open or proprietary fileformat such as way, ogg, mpc, flac, aiff, raw, au, dct, vox, mmf, mp3,aac, mp4/m4a, wma, ra & rm, dss, msv, dvf, IVS, m4p, 3gp, amr, or awb.The first MD 106 may download (e.g., all at once or progressive) orstream the audio file 128 from the second MD 124.

Exemplary Mobile Device

Referring now to FIG. 2, a schematic block diagram of an exemplarymobile device (MD) 200 and components thereof is illustrated. Althoughconnections are not shown between the components illustrated in FIG. 2,the components can interact with each other to carry out devicefunctions. In some embodiments, for example, the components are arrangedso as to communicate via one or more busses (not shown). It should beunderstood that FIG. 2 and the following description are intended toprovide a general understanding of a suitable environment in whichvarious aspects of the disclosed embodiments can be implemented.

In some embodiments, the first MD 106 illustrated in FIG. 1 isconfigured like the illustrated MD 200, now described. In someembodiments, the MD 200 is a multimode headset configured to provideaccess to more than one network type such as the wireless communicationsnetwork 110 and the local wireless communications network 112.

In some embodiments, the MD 200 includes computer-readable media,including, for example, volatile media, non-volatile media, removablemedia, and non-removable media. The term “computer-readable media” andvariants thereof, as used herein with respect to the MD 200, refer tostorage media and communication media. In some embodiments, storagemedia includes volatile and/or non-volatile, removable, and/ornon-removable media. For example, storage media includes random accessmemory (RAM), read-only memory (ROM), electrically erasable programmableread-only memory (EEPROM), solid state memory or other memorytechnology, CD-ROM, DVD, or other optical disk-based storage, magnetictape, magnetic disk storage or other magnetic storage devices, or anyother tangible, non-transitory medium that can be used to store thedesired information and that can be accessed by the MD 200.

As illustrated in FIG. 2, the MD 200 includes a display 202 forpresenting multimedia such as, for example, short messaging system (SMS)messages, enhanced messaging service (EMS), multimedia messaging service(MMS) messages, customer service messages, over-the-air (OTA) messages,unstructured supplementary service data (USSD) messages, voicemailnotification messages, application graphical user interfaces (GUIs),text, images, video, telephony functions, such as Caller ID data, setupfunctions, menus, music, metadata, wallpaper, graphics, Internetcontent, multicast content, broadcast content, social networkingcontent, game content, device status, preferences settings, map andlocation data, search information, profile (e.g., vibrate, silent, loud)selection, and the like. In one embodiment, the display 202 isconfigured to present relevant information of the second user 120, asdescribed in greater detail below.

The illustrated MD 200 also includes a processor 204 for processing dataand/or executing computer-executable instructions of one or moreapplications 208 stored in a memory 206. In some embodiments, theapplication(s) 206 include a user interface (UI) application 210. The UIapplication 210 interfaces with a client 212 (e.g., an operating system(OS)) to facilitate user interaction with device functionality and data.In some embodiments, the client 212 is one of Symbian OS® (Symbian OS isa registered trademark of Symbian Limited, of London, England),Microsoft® Windows® Mobile OS (Microsoft and Windows are registeredtrademarks of the Microsoft Corporation of Redmond, Wash.), Microsoft®Windows® Phone OS, Palm webOS® (Palm WebOS is a registered trademark ofthe Palm Trademark Holding Company, of Sunnyvale, Calif.), Palm OS®(also a registered trademark of the Palm Trademark Holding Company),RIM® BlackBerry® OS (RIM and Blackberry are registered trademarks ofResearch In Motion Limited of Waterloo, Ontario, Canada), Apple® iOS(Apple and iPhone are registered trademarks of the Apple Corporation, ofCupertino, Calif.), or Google Android® OS (Android is a registeredtrademark of Google, Inc., of Mountain View, Calif.). These operatingsystems are merely exemplary of the operating systems that can be usedin accordance with the embodiments disclosed herein. Other operatingsystems or versions of the aforementioned operating systems arecontemplated.

The UI application 210 aids a user in activating service OTA, ifapplicable, entering message content, viewing received messages (e.g.,MMS messages, SMS messages, USSD messages, OTA messages),answering/initiating calls, entering/deleting data, entering and settinguser IDs and passwords for device access, configuring settings,manipulating address book content and/or settings, multimodeinteraction, interacting with other applications 214, and the like.

In one embodiment, the other applications 214 include an applicationthat when executed by the processor 204 causes the processor 204 toperform one or more steps of the methods described herein below withreference to FIGS. 3-6. In some embodiments, the other applications 214include, for example, visual voicemail applications, messagingapplications (e.g., SMS, EMS, and MMS applications), presenceapplications, text-to-speech applications, speech-to-text applications,add-ons, plug-ins, email applications, music applications, videoapplications, camera applications, location service applications (LSAs),power conservation applications, game applications, productivityapplications, entertainment applications, enterprise applications,combinations thereof, and the like. The applications 208 are stored inthe memory 206 and/or as a firmware 216, and are executed by theprocessor 204. The firmware 216 may also store code for execution duringdevice power up and power down operations.

The MD 200 also includes an input/output (I/O) interface 218 forinput/output of data such as location information, presence statusinformation, user IDs, passwords, and application initiation (start-up)requests. In some embodiments, the I/O interface 218 is a hardwireconnection such as a USB, mini-USB, audio jack, PS2, IEEE 1394, serial,parallel, Ethernet (RJ48) port, RJ11 port, HDMI port, mini-HDMI, and thelike. In some embodiments, the I/O interface 218 is a proprietaryinterface. In some embodiments, the I/O interface 218 accepts other I/Odevices such as keyboards, keypads, mice, interface tethers, styluspens, printers, solid state memory drives, touch screens, multi-touchscreens, touch pads, trackballs, joysticks, directional pads, analogcontrol sticks, microphones (e.g., the microphone 108), remote controldevices, monitors, displays (e.g., liquid crystal displays (LCDs), lightemitting diode (LED) backlight LCD, and organic LED (OLED)) combinationsthereof, and the like. It should be appreciated that the I/O interface218 may be used for communications between the MD 200 and a networkdevice or local device, instead of, or in addition to, a communicationscomponent 220.

The communications component 220 interfaces with the processor 104 tofacilitate wired/wireless communications with external systems. Exampleexternal systems include, but are not limited to, SMS service centers(SMSCs), intranets, network databases, network storage systems, cellularnetworks (e.g., the wireless communications network 110), locationservers, presence servers, VoIP networks, local area networks (LANs),wide area networks (WANs), metropolitan area networks (MANs), personalarea networks (PANs), and other networks, network components, andsystems described herein. In some embodiments, the external systems areimplemented using Wi-Fi™, WiMAX™, combinations and/or improvementsthereof, and the like. In some embodiments, the communications component220 includes a multimode communications subsystem for providing cellularcommunications via different cellular technologies. In some embodiments,for example, a first cellular transceiver 222 operates in one mode, suchas, GSM, and an Nth cellular transceiver 224 operates in a differentmode, such as UMTS or LTE. While only two cellular transceivers 222, 224are illustrated, it should be appreciated that a plurality oftransceivers can be included. Moreover, a portion of or the entirety ofthe communications component 220 may be provided as an add-on to the MD200. The add-on may attach or wirelessly communicate with the MD 200 viathe I/O interface 218 using a standardized or proprietary communicationspecification.

The illustrated communications component 220 also includes analternative communications transceiver 226 for use by othercommunications technologies such as, for example, Wi-Fi™, Wi-Max™,Bluetooth™, near-field communications (NFC), infrared, infrared dataassociation (IrDA), other unlicensed short-range radio frequencies, andthe like. In some embodiments, the communications component 220 alsofacilitates reception from terrestrial radio networks, digital satelliteradio networks, Internet-based radio services networks, combinationsthereof, and the like.

The MD 200 also includes a SIM slot interface 228 for accommodating aSIM 230 such as a SIM card, a universal SIM (USIM) card, or a universalintegrated circuit card (UICC) including one or more SIM applications(e.g., ISIM, SIM, USIM, CSIM).

Audio capabilities for the MD 200 may be provided by an audio I/Ocomponent 232 that includes a speaker for the output of audio signalsand a microphone (e.g., the microphone 108) to collect audio signalssuch as the audio input 126, illustrated in FIG. 1. The microphone maybe internal or external to the MD 200, the latter of which may be inwired or wireless communication with the MD 200 via, for example, theI/O interface 218 or the alternative communications transceiver 226.Moreover, the microphone may be configured with directionality andsensitivity characteristics to facilitate capture of the audio input 126in varying environments. These characteristics may be configured viahardware and/or software by the manufacturer of the microphone, thefirst user 104, or a third party. For example the microphone may be adirectional or non-directional microphone and may include one or moresensors. Various types of microphones such as microelectromechanicalsystems (MEMs) microphones, fiber optic microphones, laser microphones,piezoelectric microphones, and the like, are contemplated.

In some embodiments, the microphone is an ear piece that the first user104 can wear. In these embodiments, the ear piece microphone may be inwired or wireless communication with the MD 200. Other wearableembodiments are contemplated such as incorporation of the microphoneinto a piece of jewelry, an article of clothing, or an accessory. Inother embodiments, the microphone is embedded under the skin, in theear, or elsewhere on the body of the first user 104. The microphone mayalso be attached to the skin using an adhesive tape, glue, or some otherbonding material.

The MD 200 may also include an image capture and processing system 234(image system). Photos may be obtained via an associated image capturesubsystem of the image system 234, for example, a charge-coupled device(CCD) or active pixel sensor (APS) camera. The MD 200 may also include avideo system 236 for capturing, processing, recording, modifying, and/ortransmitting video content. Photos and videos obtained using the imagesystem 234 and the video system 236, respectively, may be added asmessage content to an MMS message and sent to another mobile device.

The MD 200 also includes a location component 238 for sending and/orreceiving signals such as, for example, GPS data, assisted GPS (A-GPS)data, Wi-Fi™/Wi-Max™, and/or cellular network triangulation data,combinations thereof, and the like, for determining a location of the MD200. The location component 238 may communicate with the communicationscomponent 220 to retrieve triangulation data for determining a location.In some embodiments, the location component 238 interfaces with cellularnetwork nodes, telephone lines, satellites, location transmitters and/orbeacons, wireless network transmitters and receivers, for example,Wi-Fi™ hotspots, short-range radio transmitters, combinations thereof,and the like. Using the location component 238, the MD 200 obtains,generates, and/or receives data to identify its location, or transmitsdata used by other devices to determine the location of the MD 200.

The MD 200 also includes a power source 240, such as batteries and/orother power subsystem (AC or DC). The power source 240 may interfacewith an external power system or charging equipment via a power I/Ocomponent 242.

Exemplary Methods

While the processes or methods described herein may, at times, bedescribed in a general context of computer-executable instructions, thepresent methods, procedures, and processes can also be implemented incombination with other program modules and/or as a combination ofhardware and software. The term application, or variants thereof, isused expansively herein to include routines, program modules, programs,components, data structures, algorithms, and the like. Applications canbe implemented on various system configurations, including servers,network nodes, single or multiple processor computers, handheldcomputing devices, mobile communications devices, microprocessor-basedconsumer electronics, programmable electronics, network elements,gateways, network functions, devices, combinations thereof, and thelike. In particular, the following methods may be executed, at least inpart, by the first MD 106 which, in one embodiment, is configured likethe MD 200, as described above. Other embodiments are contemplated inwhich the MD 200 shares execution tasks with one or more servers (notshown) and/or the second MD 124.

It should be understood that the steps of the following methods are notnecessarily presented in any particular order and that performance ofsome or all the steps in an alternative order is possible and iscontemplated. The steps have been presented in the demonstrated orderfor ease of description and illustration. Steps can be added, omittedand/or performed simultaneously without departing from the scope of theappended claims. It should also be understood that the illustratedmethods can be ended at any time. In certain embodiments, some or allsteps of these methods, and/or substantially equivalent steps can beperformed by execution of computer-readable instructions stored orincluded on a non-transitory computer-readable medium.

Turning now to FIG. 3, a method 300 for facilitating an enhanced socialinteraction using a mobile device such as the first MD 106 isillustrated. The method 300 begins and flow is to block 302, whereat thefirst MD 106 receives an audio input and an identifier. In oneembodiment, the first MD 106 receives the audio input as the audio input126 via a microphone such as the microphone 108. In another embodiment,the first MD 106 receives the audio input as the audio file 128 via atransceiver such as a transceiver of the communications component 220.

In general, the identifier is used by the first MD 106 to identify thesecond user 120 so the first MD 106 can access social networkinginformation associated with the second user 120 that is potentiallyrelevant and available (e.g., based upon privacy settings) to the firstuser 120 for use (e.g., in initiating or progressing a conversation) ina social interaction between the first user 104 and the second user 120.The identifier includes a telephone number, a name, an alias, a username, or other means for identifying the second user 120. In oneembodiment, the first MD 106 receives the identifier via a transceiversuch as a transceiver of the communications component 220. For example,the first MD 106 may receive the identifier via the alternativecommunications transceiver 226 from another device such as the second MD120 or the data network 116. Alternatively, the first MD 106 may receivethe identifier via a cellular transceiver such as one of the cellulartransceivers 222, 224. The first MD 106 by similar means may share anidentifier associated with the first user 104 with the second MD 124.The second MD 124 may permit or deny further access based upon theidentifier of the first user 104.

In one embodiment, the first MD 106 sends a request for the identifierbefore, during, or after the first MD 106 receives the audio input. Thesecond MD 124, in response to receiving the request, may respond bysending an identifier to the first MD 106 in the same or similar mannerin which the second MD 106 received the request. This may be doneautomatically by the second MD 124 or in response to user input.

The second MD 124 may be configured with privacy settings established byor for the second user 120 to permit or deny a response to the request.The privacy settings, in some embodiments, mirror those established byor for the second user 120 in an account of a social networking platformthat is associated with the second user 120. For example, certainindividuals may have no access, limited access, or full access to all orportions of the second user's 120 social networking account, and similaraccess permissions may apply to the first user 104 or other userrequesting an identifier from the second MD 124 based upon theindividuals access permissions of the second user's 120 socialnetworking account.

At block 304, the first MD 106 determines a salient portion of the audioinput, as described in greater detail below with reference to FIGS. 4and 5. At block 306, the first MD 106 receives relevant informationassociated with the salient portion of the audio input, as described ingreater detail below with reference to FIG. 6. At block 308, the firstMD 106 presents the relevant information via a display and/or audiooutput and the method 300 can end. The relevant information may bepresented as audio, video, photographic images, text, graphics, and/ordata. The audio output may be at least one of a speaker, an audio outputjack to which a wired audio output device is connected, and a wirelessaudio output component to which a wireless audio output device isconnected.

Referring now to FIG. 4, a method 400 for determining a salient portionof an audio input is illustrated, according to one embodiment. Themethod 400 begins and flow is to block 402, whereat the first MD 106converts at least a portion of the audio into text using aspeech-to-text application of the mobile device, such as thespeech-to-text application described above with reference to the otherapplications 214 of FIG. 2. At block 404, the first MD 106 identifies atleast one keyword from the text. At block 406, the first MD 106 uses thekeyword as the salient portion. The method 400 can end.

Keywords include words that are considered by the mobile device as beingpotentially salient to the first user 104 based upon one or more factorssuch as preferences of the first user 104, preferences of the seconduser 120, features of a social networking profile of the first user 104,features of a social networking profile of the second user 120, socialnetworking privacy settings of the second user 120, current events, orother topical information for a particular context.

The first user 104 may establish preferences for the types ofinformation he or she considers to be potentially salient or isotherwise interested in as potential conversation subjects. For example,if the first user 104 establishes a preference for common interest as acontributing factor to ascertaining potential salience of a word, themobile device would consider the common interests of the first user 104,as defined by the first user 104 on the mobile device or as obtainedfrom the data store(s) 118 from social network platform accountassociated with the first user 104. Any word from the converted audioinput that is related to a common interest or other preference of thefirst user 104 may then be identified (e.g., flagged) as being a keywordfor consideration as at least part of the salient portion of the audioinput. Likewise, the second user 120 may establish preferences for thetypes of information he or she considers to be potentially salient. Forthe second user 120, this information may be information the second user120 considers, for example, as a potential topic of conversation.

Social networking privacy settings may also contribute to a particularword being identified as a keyword for consideration as at least part ofthe salient portion of the audio input. The second user 120 may allowall or a portion of interested persons to access his or her socialnetworking information including profile information such as physicaladdress, telephone number, email address, chat client handle, user name,avatar, profile picture, religious beliefs, age, gender, marital status,career, education, and the like, and other information such as posts bythe second user 120 on a social networking website, posts by friends,organizations, businesses, or others on second user's 120 space within asocial networking website, a topic of interest to the second user 120(e.g., politics, religion, sports, history, technology, entertainment,etc.), a specific detail about a topic of interest to the second user120 (e.g., a result of a recent presidential election), or the like. Ifthe first user 104 has not yet established a relationship with thesecond user 120 via the social networking platform, the first user 104may not be privy to information that could be used by the mobile deviceto identify a particular word as being potentially salient. On otherhand, if the second user 120 has permitted information to be shared withthe first user 104, be it an established relationship or permissiongranted by the second user 120 for others to access his or her socialnetworking information, the mobile device could identify a particularword as being potentially salient based at least in part upon thatinformation. For example, the second user 120 may share all or a portionof their social networking information and from which the mobile devicecan infer whether one or more words included in the converted audioinput should be considered salient.

Referring to FIG. 5, a method 500 for determining a salient portion ofan audio input is illustrated, according to another embodiment. In oneembodiment, the audio input is the audio input 126. In anotherembodiment, the audio input is the audio file 128. The method 500 beginsand flow is to block 502, whereat the mobile device (e.g., the first MD106) analyzes at least a portion of the audio input. At block 504, basedupon the analysis, the first MD 106 identifies at least one keyword fromthe analyzed portion of the audio input. The keyword may be determinedas described above using the audio input as the source data instead ofthe text (converted audio input) as the source data. At block 506, thefirst MD 106 uses the at least one keyword as the salient portion. Themethod 500 can end.

Referring to FIG. 6, a method 600 for determining relevant informationfor a social interaction, according to one embodiment. The method 600begins and flow is to block 602, whereat the first MD 106 compares thesalient portion of the audio input as determined, for example, by one ofthe methods 400, 500 described above, to social network information thatis stored in the data store(s) 118 and is associated with the seconduser 120 as identified, for example, by the identifier received in themethod 300. At block 604, the first MD 106, based upon the comparison,determines relevant information of the social networking information forpresenting to the first user 104 via a display and/or audio output ofthe first MD 106. The method 600 can end.

The law does not require and it is economically prohibitive toillustrate and teach every possible embodiment of the present claims.Hence, the above-described embodiments are merely exemplaryillustrations of implementations set forth for a clear understanding ofthe principles of the disclosure. Variations, modifications, andcombinations may be made to the above-described embodiments withoutdeparting from the scope of the claims. All such variations,modifications, and combinations are included herein by the scope of thisdisclosure and the following claims.

What is claimed is:
 1. A method operating a first communication mobiledevice to facilitate a social interaction, the first communicationmobile device comprising an IO interface, a processor, a communicationcomponent, a user interface, and a display, the IO interfacecommunicating with a wearable audio input device, the method comprising:receiving, from the wearable audio input device by the IO interface, anaudio input of an in-person conversation between a first user and asecond user; identifying an identity of the second user; determining, bythe processor, a salient portion of the audio input; receiving, by thecommunication component, relevant information associated with theidentity of the second user based on the salient portion of the audioinput; and displaying, by the display, the relevant information; whereindetermining the salient portion of the audio input further comprisesmatching the audio input against a set of established keywords.
 2. Themethod of claim 1, further comprising receiving the set of establishedkeywords.
 3. The method of claim 2, wherein the set of establishedkeywords is defined by the first user through the user interface.
 4. Themethod of claim 2, wherein the set of established keywords is receivedthrough the communication component from a server.
 5. The method ofclaim 1, wherein identifying the identity of the second user furthercomprises receiving identity information, via short-range communication,from a second mobile device.
 6. The method of claim 1, whereinidentifying the identity of the second user further comprises:receiving, by the communication component, a voice print of the seconduser; and comparing, by the processor, the voice print with the audioinput.
 7. A mobile communication device, for facilitating a socialinteraction, comprising: an IO interface for receiving, from a wearableaudio input device, an audio input of an in-person conversation betweena first user and a second user; a processor for identifying an identityof a second user associated based on the audio input and for determininga salient portion of the audio input by matching the audio input againsta set of established keywords; a communication component for receivingrelevant information associated with the identity of the second userbased on the salient portion of the audio input; a display fordisplaying the relevant information; and a user interface for receivinginput from a first user.
 8. The mobile communication device of claim 7,wherein the communication component further receives the set ofestablished keywords.
 9. The mobile communication device of claim 8,wherein the set of established keywords is defined by the first userthrough the user interface.
 10. The mobile communication device of claim8, wherein the set of established keywords is received through thecommunication component from a server.
 11. The mobile communicationdevice of claim 7, wherein the processor receives identity information,via short-range communication, from a second mobile device.
 12. Themobile communication device of claim 7, wherein the communicationcomponent receives a voice print of the second user and the processorcompares the voice print with the audio input.
 13. A mobilecommunication device, for facilitating a social interaction, comprising:a communication transceiver for receiving information from a secondmobile communication device; and a processor for identifying an identityof a second user associated with the second mobile communication devicebased on the received information and for checking the identity of thesecond user against a privacy setting, wherein the communicationtransceiver denies further communication with the second communicationdevice based on a result of checking the identity of the second useragainst the privacy setting.
 14. The mobile communication device ofclaim 13, wherein the communication transceiver comprises a near-fieldcommunication module.
 15. The mobile communication device of claim 13,wherein the communication transceiver comprises a short-range radiomodule.
 16. The mobile communication device of claim 13 furthercomprising: a communication component for receiving relevant informationassociated with the identity of the second user; an IO interface forreceiving, from a wearable audio input device, an audio input of anin-person conversation between a first user and the second user; adisplay for displaying the relevant information; and a user interfacefor receiving input from the first user.
 17. The mobile communicationdevice of claim 16, wherein the processor determines a salient portionof the audio input by matching the audio input against a set ofestablished keywords.
 18. The mobile communication device of claim 17,wherein the set of established keywords is defined by the first userthrough the user interface.
 19. The mobile communication device of claim13, wherein the communication transceiver allows further communicationwith the second communication device based on the result of checking theidentity of the second user against the privacy setting.
 20. The mobilecommunication device of claim 13 further comprising an IO interfacereceiving an audio input from a wearable audio input device.